Decoding complexity for mobile multimedia streaming

ABSTRACT

A decoding complexity may be used to predict power consumption for receiving, decoding, and/or displaying multimedia content at a wireless transmit/receive unit (WTRU). The decoding complexity may be based on decoding complexity feedback received from a reference device, such as another WTRU. The decoding complexity feedback may be based on measurements performed at the reference device for receiving decoding, and/or displaying the multimedia content. A content providing device may indicate the decoding complexity of requested media content to a WTRU, or another network entity. The decoding complexity may be indicated in a streaming protocol or file associated with the media content. The WTRU, or other network entity, may use the decoding complexity determine its preferences regarding transmission of the media content. The content providing device may determine whether to transmit the media content based on the decoding complexity and/or the preferences of the WTRU or other network entity.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims the benefit of U.S. Provisional PatentApplication No. 61/715,466, filed on Oct. 18, 2012, the contents ofwhich are hereby incorporated by reference in their entirety.

BACKGROUND

Multimedia content may be sent from a content provider to a mobiledevice using a wireless communications network. The content may beprovided by streaming the content such that the content may be receivedat the mobile device and/or provided to an end user of the mobiledevice. Mobile multimedia streaming may allow the mobile device to beginplayback of the media content before the entire media file has beenreceived at the device.

Streaming the multimedia content to a mobile device may be challengingdue to the variability of the available bandwidth and the potentialdemand on the battery during the period of the multimedia experience.Due to the variability of the available bandwidth on the wirelesscommunication network, the power consumed by the radio interface of themobile device for receiving the multimedia content may be unknown ordifficult to determine. Once the multimedia content is received at themobile device, the decoding and playback of the content may consumeadditional power that may also be unknown or difficult to determine.

Due to the difficulty in determining the power consumed by the mobiledevice during the multimedia experience, unnecessary resources are beingused by the mobile device and the network to transmit and/or displaymedia data.

SUMMARY

Systems, methods, and apparatuses are described herein for predictingpower consumption for receiving, decoding, and/or displaying multimediacontent at a wireless transmit/receive unit (WTRU). A WTRU may requestmultimedia content from a content providing device. The contentproviding device may receive the request for the multimedia content andmay determine a decoding complexity associated with the multimediacontent. The decoding complexity may be based on data that indicates anamount of power used to receive, decode, and/or display the multimediacontent at reference devices, such as WTRUs. For example, the decodingcomplexity may indicate a minimum decoding complexity value, a maximumdecoding complexity value, and/or an average decoding complexity valuefor receiving, decoding, and/or displaying multimedia content atreference devices.

The multimedia content may include video content (e.g., video streams,video files, etc.), images, audio content, and/or other forms ofmultimedia content. The multimedia content may be comprised of differenttypes of content. For example, where the media content includes videocontent the media content may include a standard version and a highdefinition version of the media content. The multimedia content may besegmented. Each of the different types and/or segments of media contentmay have a corresponding decoding complexity.

The content providing device may send an indication of the decodingcomplexity to the WTRU or other network device. The indication of thedecoding complexity may be included in a media tile or protocol. TheWTRU, or another network device, may use the decoding complexity todetermine whether to receive the requested media content. For example,the WTRU may compare the decoding complexity with the amount ofavailable power resources available at the WTRU. Where multiple types orsegments of content are included in the requested multimedia content,the WTRU, or other network device, may use the decoding complexity toselect one or more types or segments of content.

The content providing device may also, or alternatively, determinewhether to provide the requested media content, or one or more types orsegments thereof, based on the associated decoding complexity. Thecontent providing device may know various WTRU device characteristicsand may use them to determine whether to provide the requested mediacontent, or one or more types or segments thereof. The WTRU devicecharacteristics may include the WTRU type, available power of the WTRU,and/or the power consumption configurations of the WTRU.

BRIEF DESCRIPTION OF THE DRAWINGS

A more detailed understanding of the embodiments disclosed herein may behad from the following description, given by way of example inconjunction with the accompanying drawings.

FIG. 1 is a diagram that depicts example communication states that maybe used by a wireless transmit/receive unit (WTRU) in a wirelesscommunication system.

FIG. 2 is a graph that depicts an example for streaming video contentfrom a content provider.

FIG. 3 is another graph that depicts an example for streaming videocontent from a content provider

FIG. 4 is a flow diagram that illustrates an example process fortransmitting media content based on a decoding complexity.

FIG. 5 is a flow diagram that illustrates an example process forselecting multimedia content based on a decoding complexity.

FIG. 6 is a flow diagram that illustrates an example process formeasuring decoding complexity and/or sending decoding complexityfeedback information that indicates the decoding complexity.

FIG. 7 is a diagram that depicts an example message that may be used forsending decoding complexity feedback information.

FIG. 8A depicts a system diagram of an example communications systemwhich one or more disclosed embodiments may be implemented.

FIG. 8B depicts a system diagram of an example wireless transmit/receiveunit (WTRU) that may be used within the communications systemillustrated in FIG. 8A.

FIG. 8C depicts a system diagram of an example radio access network andan example core network that may be used within the communicationssystem illustrated in FIG. 8A.

FIG. 8D depicts a system diagram of another example radio access networkand another example core network that may be used within thecommunications system illustrated in FIG. 8A.

FIG. 8E depicts a system diagram of another example radio access networkand another example core network that may be used within thecommunications system illustrated in FIG. 8A.

DETAILED DESCRIPTION

A content provider may provide multimedia content to wirelesstransmit/receive units (WTRUs) over a wireless communication network.The amount of power consumed by a WTRU during a multimedia experiencemay be predicted based on the type of multimedia content and/or the WTRUcharacteristics. Measurements may be taken by WTRUs that have received,decoded, and/or displayed the multimedia content. These measurements maybe used to predict the amount of power that may be consumed whenreceiving, decoding, and/or displaying the multimedia content.

A power consumption descriptor may be used to indicate the amount ofpower consumed by the WTRU during the multimedia experience. Forexample, the power consumption descriptor may indicate the amount ofpower consumed by the WTRU when receiving, decoding, and/or displayingthe multimedia content. The power consumption descriptor may be referredto as a decoding complexity. The power consumption descriptor may beincluded in protocols, file formats, and/or the like. The powerconsumption descriptor may be based on a media stream or streams and/ora WTRU type or types.

Power consumption at a WTRU may be affected by streaming multimediacontent in a communications system. The multimedia content may includevideo streams, images, audio, and/or other forms of multimedia datatransmitted using the communication system. A video stream may be codedinto various sub-streams by varying the video resolution, frame rate,and/or quantization parameter. The sub-streams may include H.264streams, for example. Audio streams may also be coded into varioussub-streams by a varying number of channels (e.g., 5.1, 2.0—stereo,1.0—mono, etc.), different codecs, and/or codec extensions (e.g., MP3,advanced audio coding (AAC), high efficiency (HE)-AAC, etc.).

Power may be consumed at the WTRU for multimedia data processing and/ordisplay. The power consumed by the wireless interface may account for aportion (e.g., about 15% to 25%) of the overall power consumption. Thewireless interface may be the wireless module capable of receiving asignal and/or decoding the signal into digital data that may be passedto a multimedia decoding module. The wireless interface may communicatevia Wi-Fi, 3G, 4G, and/or the like. The display of the WTRU may accountfor a portion of the aggregate power consumed for video playback. Thedisplay may account for the largest portion (e.g., between about 38% and68%) of power consumed by components within the WTRU. The processor mayaccount for a portion of the power consumed for video playback. Theprocessor may account for the largest portion of power consumption forvideo playback after the display.

A call module may account for additional power that may be consumed forphone calls. The call module may be a GSM module or other module thatmay be used for processing call data. The power consumed by the callmodule may be static or dynamic.

Multimedia content may be pre-fetched or may be streamed for display atthe WTRU. The multimedia content may be pre-fetched at a WTRU when thecontent is fully received at the WTRU before the WTRU may begindisplaying a portion of the content. The multimedia content may bestreamed by being sent to the WTRU in segments that may be displayed atthe WTRU before the multimedia content is fully received. By streamingthe multimedia content, a portion of the content may be viewed prior toreceiving the entirety of the multimedia content. Multimedia content maybe transmitted in segments using adaptive hypertext transfer protocol(HTTP) streaming. The periods between segments may be long enough forthe air interface module to go to a sleep mode or idle mode in betweentransmissions.

FIG. 1 is a diagram that depicts example communication slates that maybe used by a WTRU in a wireless communication system. The communicationstates may include connected states for transmitting and/or receivingtransmissions at a WTRU and/or idle states that may be used betweentransmissions. The power consumed by the WTRU may depend on transitionbetween the communication states. For example, the WTRU may save powerby transitioning from a connected state to a power saving connectedstate and/or an idle state, as shown in FIG. 1.

The example communication states may include radio resource control(RRC) states, such as the RRC connected state 102 and/or the RRC idlestate 104. When Evolved Universal Mobile Telecommunications System(UMTS) Terrestrial Radio Access (E-UTRA) is implemented as a radiotechnology, such as in a long term evolution (LTE) communication systemfor example, the RRC connected state 102 may be an E-UTRA RRC connectedstate and/or the RRC idle state 104 may be an E-UTRA RRC idle state. TheRRC connected state 102 may be used to transfer data (e.g., unicastdata) to and/or from a WTRU. The RRC connected state 102 may be used,for network controlled mobility, to monitor control channels associatedwith shared data channels, and/or the like. The RRC idle state 104 maybe used to monitor a paging channel to detect incoming calls, acquiresystem information, and/or perform logging of available measurements.The RRC connected state 102 may use a higher power level than the RRCidle state 104.

The WTRU may transition between the RRC connected state 102 and the RRCidle state 104 at 106. For example, the WTRU may transition from the RRCconnected state 102 to the RRC idle state 104 after a period of time haselapsed without receiving transmissions in the RRC connected state 102.The WTRU may transition to the RRC idle state 104 to preserve batterypower, as the RRC idle state 104 may use less power resources than theRRC connected state 102. The WTRU may transition to the RRC connectedstate 102, for example, when data transmissions are received for beingprocessed in the RRC connected state 102. When the WTRU transitionsbetween the RRC connected state 102 and the RRC idle state 104 at 106,the WTRU may establish a connection in the RRC connected state 102and/or release the resources used for the RRC connected state 102 whenthe WTRU transitions to the idle state 104.

The RRC connected state 102 may be subdivided into a continuousreception state, a short discontinuous reception (DRX) state, a long DRXstate, and/or the like. The short DRX state and/or the long DRX statemay be power saving connected states that may use less power than thecontinuous reception state. A WTRU may transition to the continuousreception state, for example, when the WTRU is promoted from the RRCidle state 104. The continuous reception state may be used by the WTRUto transmit and/or receive data in the communication system. The WTRUmay transition from the continuous reception state to a DRX state whenit is waiting for data in the RRC connected state 102. For example, thecommunication device may transition from the continuous reception stateto the short DRX state. The communication device may transition from theshort DRX state to the long DRX state after a period of time has elapsedwithout receiving data in the RRC connected state 102. The long DRXstate may be an extended DRX state that may allow the WTRU to be in aDRX mode for a longer period of time prior to transitioning into idlemode.

The transition between states may be handled using inactivity timers.The WTRU may transition from the continuous reception state to the shortDRX state upon expiration of an inactivity timer T1. The inactivitytimer T1 may begin when the WTRU is no longer transmitting and/orreceiving data. The WTRU may transition from the short DRX state to thelong DRX state upon expiration of an inactivity timer T2. The WTRU maytransition from the long DRX state to the RRC idle state 104 uponexpiration of an inactivity timer T3.

A WTRU may transfer states for connectivity to other radio technologies.The WTRU may transfer states for connectivity to a UMTS, global systemfor mobile communications (GSM), or other radio technologies forexample. At 108, the WTRU may perform a handover between the RRCconnected state 102 and a UMTS connected state. At 126, the WTRU mayperform a handover between the RRC connected state 102 and a GSM/generalpacket radio service (GPRS) packet connected state.

The UMTS states 110 may include connected states and/or idle states. Theconnected states may include a CELL dedicated channel (DCH) state 112, aCELL forward access channel (FACH) state 114, and/or a CELL pagingchannel (PCH)/URA PCH 116. In the CELL_DCH state 112, the WTRU may beallocated dedicated transport channels in the downlink and/or the uplinkdirection. In the CELL_FACH state 114, the WTRU may transmit user datathrough shared channels with other WTRUs. The shared channels may below-speed channels, which may be less than 15 kbps for example. In theCELL_PCH/URA_PCH state 116, the WTRU may remain in connected mode forpaging and/or may transfer to FACH. The CELL_FACH state 114 and/or theCELL_PCH/URA_PCH state 116 may be a power saving connected state inUMTS, as they may use less power resources than the CELL_DCH slate 112.The UMTS idle states may include a UTRA idle state 120. The WTRU maytransition between a UMTS connected states 112, 114, 116 and the UTRAidle state 120 at 118. At 118, the WTRU may establish a connection withone state and/or release the resources for the other state.

The WTRU may perform reselection between a UMTS state 110 to an RRCstate. For example, the WTRU may perform reselection from a UMTSconnected state 112, 114, 116 to the RRC idle state 104 at 122. At 124,the WTRU may perform reselection between the UTRA idle state 120 and theRRC idle state 104.

The GSM/GPRS packet states 128 may include connected states and/or idlestates. The connected states may include a GSM connected state 130and/or a GPRS packet transfer mode state 132. In the GSM connected state130 and/or the GPRS packet transfer mode 132, the WTRU may have uplinkor/and downlink radio resources allocated to it and may transmit and/orreceive data. The idle states may include the GSM idle state and/or theGPRS packet idle state 136. At 134, the WTRU may transition between theGSM connected state 130 and the GSM idle slate 136 or the GPRS packettransfer mode state 132 and the GPRS packet idle state 136. The WTRU mayestablish a connection with one state and/or release the resources forthe other state.

At 140, the WTRU may perform reselection from the RRC connected state102 to the GSM idle stale/GPRS packet idle slate 136. The WTRU mayperform cell change over (CCO) reselection from a GSM/GPRS packetconnected state 130, 132 to the RRC idle state 104 at 138. At 142, theWTRU may perform CCO reselection from the RRC idle state 104 to the GSMidle/GPRS packet idle state 136. The WTRU may perform CCO reselectionfrom the GSM idle/GPRS packet idle state 136 to the RRC idle state 104at 144.

While various connected states and idle states are provided as examplesin FIG. 1, any connected state and/or idle state may be implemented. Theconnected states may be implemented to enable the WTRU to transmitand/or receive data. The power saving connected states and/or the idlestates tray be implemented to reduce power consumption at the WTRU.

FIG. 2 is a graph that depicts an example for streaming video content202 from a content provider (e.g., Hulu®, Youtube®, Netflix®, etc.). Thecontent provider may provide the video content 202 from one or morecontent providing devices that may be capable of storing and/ortransmitting video content. The video content 202 may be streamed asad-sponsored video streaming. The video content 202 may be provided at abitrate between about 4.0 Mbps and about 1.4 Mbps. The average bitratemay be about 850 Kbps.

The video content 202 may be transmitted and/or received in intervals.The intervals of video transmission 204, 206 may be followed byintervals of inactivity 208, 210. The intervals of transmission 204, 206may be about seventy-five seconds. The intervals of inactivity 208, 210may be about seventy-five seconds. During these intervals of inactivity208, 210, the WTRU may put the transmit/receive module into a powersaving state. For example, the WTRU may transition to a short DRX mode,a long DRX mode, or a CELL_FACH state during intervals of inactivity208, 210. If the intervals of inactivity are longer than the inactivitytimer for transitioning into the idle state, the WTRU may transitionfrom a connected state in intervals of transmission 204, 206 to idlemode in intervals of inactivity 208, 210.

A WTRU may have a static nature of treating intervals of multimediatraffic. For example, a WTRU may assume video segments are transmittedbetween the same inactivity timers. FIG. 3 is a graph that depicts anexample for streaming video content 302 from a content provider (e.g.,Hulu®, Youtube®, Netflix®, etc.). The video content 302 may be providedat a bitrate between about 4.5 Mbps and about 0.3 Mbps. The averagebitrate may be about 602 Kbps. The video content 302 may be split into anumber of N chunks to allow or enable a WTRU to transition from aconnected state into a power saving state in a connected mode or an idlemode. For example, the WTRU may transition from a DCH state to a FACHstate to reduce or save energy. The reduction in energy may be by abouteighty percent, for example. The WTRU may send a message (e.g., an RRCmessage) to transition into an idle state and/or release radio resourcesafter a chunk is received. The transition into the idle state and/or therelease of radio resources may be performed prior to waiting forexpiration of an inactivity timer for transitioning into the idle state.This early transition into idle state and/or release of resources may bereferred to as fast dormancy.

A WTRU may use dynamic cache management to cache chunks of the videocontent. Power may be saved by using dynamic cache management to enablethe WTRU to download content in chunks as fast as possible and/orreleasing network resources, which may be referred to as fast dormancy.The WTRU may turn off the transmit/receive module to save power. TheWTRU may close the connection (e.g., transmission control protocol (TCP)connect on) when the cache may be full.

Power consumption models may be used for decoding media content inWTRUs. The power consumed for hardware accelerated decoding of mediacontent at WTRUs may be determined as described herein. The mediacontent may include video content, such as H.264 video content forexample, images, audio content, and/or other types of media content. Thedecoding of video content may be modeled as a multiplicative of threeexponential functions of main H.264 encoding parameters, as shown inEquation (1):

$\begin{matrix}{{P( {s,t,q} )} = {{P_{\max}( \frac{s}{s_{\max}} )}^{c_{s}}( \frac{t}{t_{\max}} )^{c_{t}}( \frac{q}{q_{\min}} )^{c_{q}}}} & {{Equation}\mspace{14mu} (1)}\end{matrix}$

where s may be the resolution, t may be the frame rate, q may be thequantization parameter, and/or P_(max)=P (s_(max),t_(max),q_(min)).Variables c_(s), c_(t), and/or c_(q) may be modeling parameters that maybe constants that may be used to obtain an accurate model. For example,the modeling parameters c_(s)=0.4, c_(t)=0.25, and/or c_(q)=0.0 may beused for Equation 1.

The power consumption of the display may be modeled as shown in Equation(2) below:

$\begin{matrix}{{{P_{display}(i)} = {{\sum\limits_{x,y}{\alpha \; {R( {x,{y;i}} )}}} + {\beta \; {G( {x,{y;i}} )}} + {\gamma \; {B( {x,{y;i}} )}}}},} & {{Equation}\mspace{14mu} (2)}\end{matrix}$

where variable i may be an instant time, x and y may be coordinates ofthe pixel (e.g., row and column coordinates). R, G, and B may be thered, green, and blue components, respectively, of a pixel displayed on ascreen. For example, R(x, y, i) may be the value of a pixel (x,y) at aninstant i. Variables α, β, and γ may be modeling parameters that may bedetermined to obtain an accurate model. For example, a display on a WTRUmay use α=1.02, β=1.91, and/or γ=2.43 in Equation 2 to determine thepower consumption of the display. For some WTRUs, display powerconsumption may be constant (e.g. ≈250 mW).

The power model parameters obtained using Equation (1) may be applied topower-rate optimized adaptive video streaming, where a maximum quality(Q) may be searched subject to rate R and power constraints P as showingin Equation (3) below:

max Q(s,t,q)

subject to: R(s,t,q)<R ₀ , P(s,t,q)<P ₀.   Equation (3)

Mobile streaming of multimedia content may be performed based on thepower consumption level associated with the multimedia data. Mobilemultimedia streaming may be performed to preserve power consumption atthe WTRU. Streaming protocols and/or file formats may include a decodingcomplexity that may be used to predict the amount of power consumptionthat may be caused by or due to receiving, decoding, and/or displayingof the underlying media streams. For example, the decoding complexitymay include power consumption descriptors that may indicate an amount ofpower that may be consumed when receiving, decoding, and/or displayingmultimedia content.

FIG. 4 is a flow diagram that illustrates an example process 400 fortransmitting media content based on a decoding complexity. Themultimedia content may include video streams, images, audio, and/orother forms of multimedia data transmitted using the communicationsystem. One or inure portions of the process 400 may be performed bycontent providing devices, such as a content providing server or serversfor example. As shown at 402, the content providing device may receivedata that may indicate an amount of power for receiving, decoding,and/or displaying media content at WTRUs. The data may be actual datathat may be measured by WTRUs that have received, decoded, and/ordisplayed the media content. The data measured by the WTRUs may bestored at the content providing device and/or a remote location that maybe accessible to the content providing device.

The content providing device may receive a request for the media contentat 404. The request may be received from a WTRU or other network entity.At 406, the content providing device may determine a decoding complexityassociated with the requested media content. The decoding complexity mayindicate the amount of power used to receive, decode, and/or display themedia content at one or more WTRUs. The decoding complexity may be anabsolute value or a relative value. For example, an absolute value of adecoding complexity may be followed by relative values that may indicatean increase or decrease in the decoding complexity. The decodingcomplexity may be based on the data received at 402. For example, thedecoding complexity may indicate a minimum amount of power, a maximumamount of power, and/or an average amount of power used by WTRUs thathave received, decoded, and/or displayed the media content. The WTRUsthat have received, decoded, and/or displayed the media content mayinclude the WTRU requesting the media content.

The decoding complexity may include separate representations forreceiving the media content, decoding the media content, and/ordisplaying the media content. The separate decoding complexityrepresentations for receiving, decoding, and/or displaying the mediacontent may allow WTRUs to tailor the complexity information based onits current state. For example, display power may be scaled to accountfor user brightness settings at the WTRU.

Different types of the requested media content may be available fortransmission to the WTRU. For example, where the media content includesvideo content, standard definition and high definition video content maybe available. The decoding complexity may indicate a minimum amount ofpower, a maximum amount of power, and/or an average amount of power usedby the WTRUs for decoding each type of media content. The decodingcomplexity may be different for different types of media content. Forexample, standard definition video content may have a lower decodingcomplexity and may use less power than high definition video content.

Media content may be encoded using different video encoding profiles.For example, in H.264, a media content type may use a baseline profile,a main profile, a high profile, etc. Each profile may use a differentset of encoding/decoding tools. Lower profiles (e.g., baseline profile)may be used to limit complexity and/or power consumption at the WTRU.Media content may be encoded using the same resolution (e.g., fullHD—1080p) and may use different video encoding profiles.

Media content may be encoded with different coding tools. Media contentmay be encoded with/without coding tools that may increase decodingcomplexity. For example, context-adaptive binary arithmetic coding(CABAC) may be more complex than variable-length coding (VLC). Mediacontent may be encoded using the same profile, but with/without codingtools. For a given profile, some coding tools may be optional. If thecoding tools are not used, the WTRU may see a lower decoding complexity.Media content may be encoded using the same profile, but using differentcoding tools.

The content providing device may select the media content fortransmission at 408. The media content may be selected at 408 based onthe decoding complexity. In order to select the media content, thecontent providing device may send an indication of the decodingcomplexity associated with the requested media content to the WTRU. Thecontent providing device may receive an indication from the of whetherthe WTRU would like to receive the media content based on the associateddecoding complexity. The content providing device may transmit theselected media content at 410.

When there are different types of media content available at the contentproviding device, the content providing device may send an indication ofone or more of the available types of content and/or the decodingcomplexity associated with each type. The content providing device mayreceive an indication from the WTRU of a preferred type of media contentbased on the decoding complexity associated therewith, and may selectthis content at 408 for transmission. The content providing device maypre-filter the types of media content that may be sent to the WTRU basedon the decoding complexity. The content providing device may know theWTRU type, available power of the WTRU, and/or the power consumptionconfigurations of the WTRU. The WTRU type, available power of the WTRU,and/or the power consumption configurations of the WTRU may be receivedfrom the WTRU or may be stored at the content providing device or otherremote location and may be looked up based on an identifier associatedwith the WTRU. The WTRU identifier, the WTRU type, the WTRU powerconfigurations, and/or the available power of the WTRU may be includedin the request for media content received at 404. The content providingdevice may use the device type, available power, and/or the powerconsumption configurations to determine whether the WTRU can processcertain types of media content.

The content providing device may provide the decoding complexity ofmedia content that may be relevant to a device based on the deviceconfigurations and/or device specifications of the WTRUs that haveprovided the decoding complexity feedback. For example, when a WTRUrequests media content from a content providing device, the request mayinclude an identifier of the WTRU. The identifier may be a uniqueidentifier or one or more device configurations or specificationsassociated with the device. The content providing device may determinethe relevant decoding complexity information based on the WTRUidentification information provided by the WTRU and may provide decodingcomplexity information that may he tailored to the WTRU.

The content providing device may provide the decoding complexityinformation along with device identification information that mayidentify devices to which the decoding complexity information may berelevant. For example, when a WTRU requests media content from a contentproviding device, the content providing device may provide the decodingcomplexity for the media content, along with one or more identifiersthat may indicate the devices to which the decoding complexity may berelevant. The content providing device may provide different versions ofthe decoding complexity such that the WTRU may determine the version ofthe decoding complexity is relevant, or most relevant, to the WTRU.

The content providing device may autonomously select the media contentat 408 based on the decoding complexity. The content providing devicemay use the device identifier and/or the WTRU configurations and/orspecifications (e.g., device type, make, model, etc.) to select themedia content to be transmitted at 408. The device configurations and/orspecifications may be available in the HTTP header of a request receivedfrom the WTRU, for example. The content providing device may determinewhether the WTRU has enough power available for receiving, decodingand/or displaying the requested media content. The content providingdevice may determine whether the decoding complexity of the mediacontent is within an acceptable range. When there are multiple types ofthe requested media content, the content providing device may select thetype of content that is appropriate for transmission to the WTRU basedon the WTRU type, the WTRU power configurations, and/or the availablepower of the WTRU.

Another network device, such as a Node B for example, may select themedia content at 408 based on the decoding complexity. The networkdevice may use the device identifier and/or the WTRU configurationsand/or specifications (e.g., device type, make, model, etc.) to selectthe media content to be transmitted at 408. The device configurationsand/or specifications may be available in the HTTP header of a requestreceived from the WTRU, for example. The network device may determinewhether the WTRU has enough power available for receiving, decodingand/or displaying the requested media content. The network device maydetermine whether the decoding complexity of the media content is withinan acceptable range. When there are multiple types of the requestedmedia content, the network device may select the type of content that isappropriate for transmission to the WTRU based on the WTRU powerconfigurations, the WTRU power configurations, network configurations(e.g., bandwidth), and/or the available power of the WTRU.

FIG. 5 is a flow diagram that illustrates an example process 500 forselecting multimedia content based on a decoding complexity. One or moreportions of the process 500 may be performed by a WTRU or other networkdevice. As shown at 502, the WTRU may request media content from acontent providing device. At 504, the WTRU may receive a decodingcomplexity associated with the requested media content. The decodingcomplexity may indicate the amount of power that may be used to receive,decode, and/or display the media content at the WTRU. The decodingcomplexity may indicate power metrics for the power used by other WTRUsthat have received, decoded, and/or displayed the media content. Forexample, the decoding complexity may indicate a minimum amount of power,a maximum amount of power, and/or an average amount of power used byother WTRUs that have received, decoded, and/or displayed the mediacontent.

The WTRU may determine whether to receive the media content at 506 basedon the decoding complexity. For example, the WTRU may determine itscurrent battery power and/or whether it has enough battery poweravailable for decoding the requested content. The WTRU may determinewhether the decoding complexity is within an acceptable range based onthe current batter power. When there are different types of mediacontent available at the content providing device, the WTRU may receivean indication of the decoding complexity for the different types ofmedia content. For example, the WTRU may receive a minimum amount ofpower, a maximum amount of power, and/or an average amount of power usedby the WTRUs for receiving, decoding, and/or displaying each type ofmedia content. The WTRU may select a preferred type of media contentbased on the decoding complexity associated with each type of mediacontent.

The WTRU may send an indication at 508 to indicate whether it wants toreceive the requested media content. The WTRU may also indicate the typeof media content that it would like to receive. The indication may besent at 508 in response to the decoding complexity received from thecontent providing device. If the WTRU indicates at 508 that it wants toreceive the media content and/or a selected type of media content, theWTRU may receive the media content in response to the indication. Themedia content may be streamed via a communication network and/or storedat the WTRU for playback. If the WTRU indicates at 508 that it does notwant to receive the media content, the media content may not betransmitted to the WTRU, or the WTRU may ignore the transmission.

FIG. 6 is a flow diagram that illustrates an example process 600 formeasuring decoding complexity and/or sending decoding complexityfeedback information that indicates the decoding complexity. One or moreportions of the process 600 may be performed by a WTRU. As shown at 602,the WTRU may request media content from a content providing device. At604, the WTRU may receive the requested media content. The media contentmay be streamed via a communication network and/or stored at the WTRUfor playback. The WTRU may decode and/or display the media content at606. The WTRU may measure the decoding complexity at 608. For example,the WTRU may measure the amount of power used while receiving, decoding,and/or displaying the media content. The WTRU may measure the maximumvalue, minimum value, and/or average value of power used by the WTRU.The average value may be calculated by the minimum value plus themaximum value divided by two (e.g., (minValue+maxValue)/2) or bycalculating the average power value used over a period of time (e.g.,the period for receiving, decoding, and/or displaying the media contentor a segment thereof). If the media content is segmented at the WTRU,the WTRU may perform the measurements at 608 for each segment of themedia content.

The WTRU may send decoding complexity feedback information to a remotesource at 610. For example, the WTRU may send the decoding complexityfeedback information to the content providing device and/or anothernetwork device for storage. The decoding complexity feedback informationmay be aggregated from multiple devices, such as in the form of adatabase for example. The decoding complexity feedback information mayinform the content providing device of the actual decoding complexityfor receiving, decoding, and/or displaying the multimedia content. Aseparate decoding complexity representation may be used by WTRUs toreport decoding complexity for receiving media content, decoding mediacontent, and/or displaying media content. The decoding complexityfeedback information may be stored and/or used to send the decodingcomplexity to other receiving devices.

The decoding complexity feedback information may also include a time atwhich the decoding complexity was measured, a duration for which thedecoding complexity was measured, and/or device configurations and/orspecifications for the device measuring the decoding complexity. Thedevice configurations and/or specifications may include a device type,make, model, release date, OS version, device drivers, player agent,available power, power consumption configurations, and/or the like. Thedecoding complexity feedback information may be used to provide thedecoding complexity to WTRUs.

The decoding complexity may be included in a file format or protocol.For example, the decoding complexity may be included in a mediapresentation descriptor (MPD) of a dynamic adaptive streaming over HTTP(DASH), a session description protocol (SDP) of an IP multimediasubsystem (IMS), a real time streaming protocol (RTSP), a file formatsuch as a 3GP file format, and/or the like.

A streaming protocol may include a value that indicates the decodingcomplexity. For example, the protocol structure may include an abstractcalled DecodingComplexity and/or may include values that indicate thedecoding complexity associated with media content being streamed via theprotocol. Provided below is an example of an abstract function calledDecodingComplexity that may be used in a streaming protocol:

Struct DecodingComplexity { Bool Absolute; IntminValue,maxValue,avrValue; Char Units[8]; };.As shown above, the DecodingComplexity function may include one or moredecoding complexity values, a value indicating whether the decodingcomplexity value is an absolute value or a relative value, and/or aunits value that may indicate the units in which the decoding complexityvalues are measured. The value indicating whether the decodingcomplexity value is an absolute value or a relative value may be aboolean value that may be used to identify if one or more of thereported values minValue, maxValue and/or avrValue may be an absolute orrelative value. If the decoding complexity values are relative values,the values may be expressed as a relative increase or decrease fromprevious values. The decoding complexity may include the valuesminValue, maxValue, and/or avrValue. The decoding complexity mayrepresent a variability of the amount of power and/or time it may take aWTRU to receive, decode, and/or display media content, such as a videostream, a video frame, a video file, an audio file, images, and/or othertypes of media content.

The decoding complexity may be based on values measured by a referencedevice. The reference device may be another WTRU. The reference devicemay be similarly configured to the device requesting the media content.For example, the reference device may have the same device type, make,model, release date, OS version, device drivers, player agent, availablepower, power consumption configurations, and/or the like. One or more ofthe configurations of the reference device may also be different, butmay be relevant for predicting the amount of power that may be used bythe device requesting the media content. The device configurations maybe included in metadata. The metadata about the configurations of thereference device may be included in a user defined box within a fileformat, such as a 3GP file format for example, or may be sent in anoutbound signaling protocol, such as an email or an HTTP websocket forexample.

When the media content includes video screams, the decoding complexitymay be used to select the appropriate video stream. For example, theavrValue may be used to select the appropriate video stream. TheavrValue may be used when video streams may include a small number offrames or shorter videos. Video streams that include a small number offrames or shorter videos may include videos less than a minute (e.g., 30seconds) or a number of minutes. The minValue and/or the maxValue may beused to capture variability of frame decoding time. The minValue and/orthe maxValue may be used with a larger number of video frames or longervideos. Longer videos or videos with a larger number of frames may belarger than the shorter videos. For example, the longer videos may belonger than an hour (e.g., 2 hours). The avrValue may be estimated as(minValue+maxvalue)/2 or may be calculated as an average value of eachof the known reference devices or a subset of the reference devices(e.g., reference devices with similar configurations).

The decoding complexity function may include the units at which thevalues are measured. For example, the decoding complexity function mayinclude a string value for the units that may indicate the units for theminValue, maxValue and/or avrValue. The units value may be inmilliseconds (msec), million instructions per second (MIPS), millliwatts(mW), and/or the like. The maximum number of characters for the unitsvalue may be a fixed number (e.g., 8 characters) or a variable number.While an example is provided for the abstract decoding complexityfunction above, the decoding complexity may be modified and/orimplemented for each streaming protocol.

The decoding complexity may be included in the moving picture expertsgroup (MPEG) DASH protocol. The media presentation description (MPD) inthe MPEG DASH protocol may be used to indicate the decoding complexity.For example, decoding complexity descriptors may be included in the MPEGDASH schema at a period, an adaptation set, a representation, and/or thelike. The adaptation set may include the set of different types of mediafiles stored at a content providing device. The representation mayinclude a media file in the adaptation set. A representation may includea different version of the same media content. For example, differentrepresentations of the same video clip may be encoded at different bitrates and/or different resolutions. A multimedia content may include apresentation (e.g., a video clip or movie) that may be partitioned intoperiods. For example, a period may be a chapter in the presentation inbetween periods, ads may be displayed. Each period may be partitionedinto segments (e.g., two to ten second segments).

The decoding complexity may be included at the period level to informthe WTRU, or another device, about the minimum and/or maximum expectedpower resources that may be used to receive, decode, and/or display arepresentation of an adaptation set(s). The decoding complexity valuesmay be absolute values or may be relative values that may reference adecoding complexity in a prior period. The absolute value may beincluded in the first period in a presentation, for example. Subsequentperiods may include a value relative to the first period. The relativevalues may reference the absolute value.

Provided below is an example of an extensible markup language (XML)scheme for the period. The XML scheme includes a minDecodingComplexityand a maxDecodingComplexity as a string value “xs:string.” A similar XMLscheme may be implemented that includes other forms of decodingcomplexity, such as average decoding complexity and/or the like.

<!-- Period of a presentation --> <xs:complexType name=“PeriodType”><xs:sequence> <xs:element name=“BaseURL” type=“BaseURLType”minOccurs=“0” maxOccurs=“unbounded”/> <xs:element name=“SegmentBase”type=“SegrnentBaseType” minOccurs=“0”/> <xs:element name=“SegmentList”type=“SegrnentListType” minOccurs=“0”/> <xs:elementname=“SegmentTemplate” type=“SegmentTemplateType” minOccurs=“0”/><xs:element name=“AdaptationSet” type=“AdaptationSetType” minOccurs=“0”maxOccurs=“unbounded”/> <xs:any namespace=“##other”processContents=“lax” minOccurs=“0” maxOccurs=“unbounded”/></xs:sequence> <xs:attribute ref=“xlink:href”/> <xs:attributeref=“xlink:actuate” default=“onRequest”/> <xs:attribute name=“id”type=“xs:string”/> <xs:attribute name=“start” type=“xs:duration”/><xs:attribute name=“duration” type=“xs:duration”/> <xs:attributename=“bitStreamSwitching” type=“xs:boolean” default=“false”/><xs:attribute name=“minDecodingComplexity” type=“xs:string”minOccurs=“0” maxOccurs=“1”/> <xs:attribute name=“maxDecodingComplexity”type=“xs:string” minOccurs=“0” maxOccurs=“1”/> <xs:anyAttributenamespace=“##other” processContents=“lax”/> </xs:complexType>The string representing minimum decoding complexity and/or the stringrepresenting the maximum decoding complexity may be formatted havingsub-strings. The sub-strings may be separated by commas or otherindicators to show the separation between sub-strings. The substringsmay indicate whether the decoding complexity is an absolute or relativevalue, the decoding complexity value, and/or the units of each decodingcomplexity value. For example, the sub-strings may indicate that thedecoding complexity is an absolute value, the value of the decodingcomplexity, and/or the units in a comma-delimited list (e.g.,minDecodingComplexity=1, 100, MIPS). While the decoding complexity isrepresented as a string value, the decoding complexity may berepresented as one or more integer values that may indicate whether thedecoding complexity is an absolute or relative value, the decodingcomplexity value, and/or the units of each decoding complexity value.

The decoding complexity may be included at the adaptation set level.This may provide a finer level of adaptation than including the decodingcomplexity at the period level. At the adaptation set level, thedecoding complexity may include the minimum, maximum, and/or averageexpected processing that may be used to receive, decode, and/or displaya representation of the adaptation set. The decoding complexity at theadaptation set level may include absolute or relative values. Therelative values may refer to a prior relative or absolute value. Forexample, the first adaptation set within a period may include absolutevalues for the decoding complexity and/or subsequent adaptation set(s)may include absolute or relative values for the decoding complexity.

The adaptation set may include a minimum decoding complexity, a maximumdecoding complexity, and/or an average decoding complexity. Providedbelow is an example of an XML scheme for the adaptation set thatincludes the minimum decoding complexity, the maximum decodingcomplexity, and the average decoding complexity as an “xs:string” value.

<!-- Group to contain information common to an adaptation set; extendsRepresentationBaseType --> <xs:complexType name=“AdaptationSetType”><xs:complexContent> <xs:extension base=“RepresentationBaseType”><xs:sequence> <xs:element name=“Accessibility” type=“DescriptorType”minOccurs=“0” maxOccurs=“unbounded”/> <xs:element name=“Role”type=“DescriptorType” minOccurs=“0” maxOccurs=“unbounded”/> <xs:elementname=“Rating” type=“DescriptorType” minOccurs=“0”maxOccurs=“unbounded”/> <xs:element name=“Viewpoint”type=“DescriptorType” minOccurs=“0” maxOccurs=“unbounded”/> <xs:elementname=“ContentComponent” type=“ContentComponentType” minOccurs=“0”maxOccurs=“unbounded”/> <xs:element name=“BaseURL” type=“BaseURLType”minOccurs=“0” maxOccurs=“unbounded”/> <xs:element name=“SegmentBase”type=“SegmentBaseType” minOccurs=“0”/> <xs:element name=“SegmentList”type=“SegmentListType” minOccurs=“0”/> <xs:elementname=“SegmentTemplate” type=“SegmentTemplateType” minOccurs=“0”/><xs:element name=“Representation” type=“RepresentationType”minOccurs=“0” maxOccurs=“unbounded”/> <xs:any namespace=“##other”processContents=“lax” minOccurs=“0” maxOccurs=“unbounded”/></xs:sequence> <xs:attribute ref=“xlink:href”/> <xs:attributeref=“xlink:actuate” default=“onRequest”/> <xs:attribute name=“id”type=“xs:string”/> <xs:attribute name=“group” type=“xs:unsignedInt”/><xs:attribute name=“lang” type=“xs:language”/> <xs:attributename=“contentType” type=“xs:string”/> <xs:attribute name=“minBandwidth”type=“xs:unsignedInt”/> <xs:attribute name=“maxBandwidth”type=“xs:unsignedInt”/> <xs:attribute name=“minWidth”type=“xs:unsignedInt”/> <xs:attribute name=“maxWidth”type=“xs:unsignedInt”/> <xs:attribute name=“minHeight”type=“xs:unsignedInt”/> <xs:attribute name=“maxHeight”type=“xs:unsignedInt”/> <xs:attribute name=“minFrameRate”type=“FrameRateType”/> <xs:attribute name=“maxFrameRate”type=“FrameRateType”/> <xs:attribute name=“segmentAlignment”type=“ConditionalUintType” default=“false”/> <xs:attributename=“subsegmentAlignment” type=“ConditionalUintType” default=“false”/><xs:attribute name=“subsegmentStartsWithSAP” type=“SAPType”default=“0”/> <xs:attribute name=“bitStreamSwitching”type=“xs:boolean”/> <xs:attribute name=“minDecodingComplexity”type=“xs:string” minOccurs=“0” maxOccurs=“1”/><xs:attributename=“maxDecodingComplexity” type=“xs:string” minOccurs=“0”maxOccurs=“1”/> <xs:attribute name=“avrDecodingComplexity”type=“xs:string” minOccurs=“0” maxOccurs=“1”/> </xs:extension></xs:complexContent> </xs:complexType> <!-- Conditional Unsigned Integer(unsignedInt or boolean) --> <xs:simpleType name=“ConditionalUintType”>  <xs:union memberTypes=“xs:unsignedInt xs:boolean”/> </xs:simpleType>The string representing the minimum decoding complexity, the maximumdecoding complexity, and/or the average decoding complexity may beformatted having sub-strings, as described herein. While the decodingcomplexity is represented as a siring value, the decoding complexity maybe represented as one or more integer values, as described herein.

The decoding complexity may be included at the representation level. Therepresentation level may provide a finer level of adaptation compared tothe period and/or the adaptation set level. The minimum, maximum, and/oraverage expected consumption of power resources that may be used toreceive, decode, and/or display a segment or sub-representation may beincluded at the representation level. The decoding complexity at therepresentation level may include absolute or relative values. Therelative values may the relative to a prior absolute or relative value.For example, the first representation within an adaptation set mayinclude an absolute value. Subsequent representation(s) may includeabsolute or relative values.

The decoding complexity at the representation level may include aminimum decoding complexity, a maximum decoding complexity, and/or anaverage decoding complexity. Provided below is an example of an XMLscheme for the representation level that includes the minimum decodingcomplexity, the maximum decoding complexity, and the average decodingcomplexity as an “xs:string” value.

<!-- A Representation of the presentation content for a specific Period--> <xs:complexType name=“RepresentationType”> <xs:complexContent><xs:extension base=“RepresentationBaseType”> <xs:seqnence> <xs:elementname=“BaseURL” type=“BaseURLType” minOccurs=“0” maxOccurs=“unbounded”/><xs:element name=“SubRepresentation” type=“SubRepresentationType”minOccurs=“0”/> <xs:element name=“SegmentBase” type=“SegmentBaseType”minOccurs=“0”/> <xs:elementname=“SegmentList” type=“SegmentListType”minOccurs=“0”/> <xs:element name=“SegmentTemplate”type=“SegmentTemplateType” minOccurs=“0”/> </xs:sequence> <xs:attributename=“id” type=“StringNoWhitespaceType” use=“required”/><xs:attributename=“bandwidth” type=“xs:unsignedInt” use=“required”/><xs:attribute name=“qualityRanking” type=“xs:unsignedInt”/><xs:attribute name=“mediaStreamStructureId” type=“StringVectorType”/><xs:attribute name=“minDecodingComplexity” type=“xs:string”minOccurs=“0” maxOccurs=“1”/> <xs:attribute name=“maxDecodingComplexity”type=“xs:string” minOccurs=“0” maxOccurs=“1”/> <xs:attributename=“avrDecodingComplexity” type=“xs:string” minOccurs=“0”maxOccurs=“1”/> </xs:extension> </xs:complexContent> </“xs:complexType”><!-- String without white spaces --> <xs:simpleTypename=“StringNoWhitespaceType”> <xs:restriction base=“xs:string”><xs:pattem value=“[{circumflex over ( )}\r\n\t \p{Z}]*”/></xs:restriction> </xs:simpleType> <!-- Whitespace-separated list ofstrings --> <xs:simpleType name=“StringVectorType”> <xs:listitemType=“xs:string”/> </xs:simpleType>The string representing the minimum decoding complexity, the maximumdecoding complexity, and/or the average decoding complexity may beformatted having sub-strings, as described herein. While the decodingcomplexity is represented as a string value, the decoding complexity maybe represented as one or more integer values, as described herein.

The decoding complexity may also be included at the sub-representationlevel in a similar manner as the representation level. Asub-representation may be used to provide a version of a representationto enable a video player to fast-forward and/or rewind efficiently. Thesub-representation may be a lower-quality than the version of arepresentation. Provided below is an example of an XML scheme for thesub-representation level that includes the minimum decoding complexity,the maximum decoding complexity, and the average decoding complexity asan “xs:string” value.

<!-- SubRepresentation --> <xs:complexType name=“SubRepresentationType”> <xs:complexContent>  <xs:extension base=“RepresentationBaseType”><xs:attribute name=“level” type=“xs:unsignedInt”/> <xs:attributename=“dependencyLever” type=“UIntVectorType”/>  <xs:attributename=“bandwidth” type=“xs:unsignedInt”/> <xs:attributename=“contentComponent” type=“StringVectorType”/><xs:attributename=“minDecodingComplexity” type=“xs:string” minOccurs=“0”maxOccurs=“1”/> <xs:attribute name=“maxDecodingComplexity”type=“xs:string” minOccurs=“0” maxOccurs=“1”/> <xs:attributename=“avrDecodingComplexity” type=“xs:string” minOccurs=“0”maxOccurs=“1”/> </xs:extension> </xs:complexContent> </xs:cornplexType><!-- Whitespace-separated list of unsigned integers --> <xs:simpleTypename=“UIntVectorType”> <xs:list itemType=“xs:unsignedInt”/></xs:simpleType>While the decoding complexity is represented as a string value, thedecoding complexity may be represented as one or more integer values, asdescribed herein.

The decoding complexity, and/or other attributes, may be signaled inMPEG DASH using generic descriptors. The generic descriptors may bedeclared at the adaptation set level, the representation level, and/orthe sub-representation level. The generic descriptors may indicatewhether the decoding complexity is an essential or supplemental elementof the MPEG DASH protocol. Essential protocol elements of the MPEG DASHprotocol may be supported by each compliant video player. Supplementalprotocol elements may include information that may or may not beunderstood each compliant video player.

Provided below is an example of an XML scheme for be representationlevel hat includes generic descriptors that indicate the decodingcomplexity as a supplemental element of the MPEG DASH protocol.

<Representation id=“720kbps” bandwidth=“792000” width=“640”height=“368” > <SubRepresentation level=“1” contentComponent=“481”maxPlayoutRate=“32”/> <SegmentBase timescale=“90000”presentationTimeOffset=“162000000” /> <SupplementalschemeIdUri=“urn:sdoX:dashX:min-decoding-complexity” value=“10” /><Supplemental schemeIdUri=“urn:sdoX:dashX:max-decoding-complexity”value=“100” /> <SupplementalschemeIdUri=“urn:sdoX:dashX:avg-decoding-complexity” value=“50” /></Representation>If uniform resource names (URNs) are used in the protocol, as shownabove, the URNs may include “urn:sdoX:dashX:min-decoding-complexity” forthe minimum decoding complexity,“urn:sdoX:dashX:max-decoding-complexity” for the maximum decodingcomplexity, and/or “urn:sdoX:dashX:avg-decoding-complexity” for theaverage decoding complexity.

The decoding complexity may be included as a parameter to a mediastreaming format. The media streaming format may be the sessiondescription protocol (SDP) for a session initiation protocol, areal-time streaming protocol (RTSP), and/or the like. The decodingcomplexity may be included in the SDP following a media attributesvariable “m=video,” for example. The decoding complexity may include theminimum, maximum, and/or average expected processing resources that maybe used to receive, decode, and/or display the media stream. Thedecoding complexity may include absolute or relative values. The firstmedia component within the SDP may include absolute values. Subsequentmedia components may include absolute or relative values. The relativevalues may be relative to the values in the first media component withinthe SDP or may be relative to the previous media component SDP mayimplement a decoding complexity attribute. For example, the decodingattribute “a” may be implemented as follows:a=DecodingComplexity:<decoding Absolute> <minDecodingComplexity><maxDecodingComplexity> <avrDecodingComplexity> <decoding Units>. Thedecoding complexity attribute may include an indication of whether thedecoding complexity is an absolute or relative value, a minimum decodingcomplexity, a maximum decoding complexity, an average decodingcomplexity, and/or the units for which the decoding complexity may bemeasured. The decoding complexity attribute may be sent during aninitial offer and/or answer negotiation, such as a negotiation betweenthe WTRU and the content providing device for example. The decodingcomplexity attribute may be sent during an ongoing video streamingsession to modify one or more SDP attributes.

The decoding complexity may be included in real-time transport controlprotocol (RTCP) messages. For example, the decoding complexity may beincluded in an RTCP extension in an RTCP message. Content providingdevices may send the decoding complexity in sender reports to one ormore receiving devices, such as a WTRU or other network device forexample.

The receiving devices may be reference devices that may send decodingcomplexity feedback information to the content providing devices toinform the content providing devices of the actual decoding complexityassociated with selected multimedia content. For example, the receivingdevices may include the actual decoding complexity in RTCP messages sentto the content providing devices. The decoding complexity feedbackinformation may inform the content providing devices of the actualdecoding complexity of selected media content at the receiving deviceson which the media content has been received, decoded, and/or displayed.The decoding complexity feedback information may be stored at thecontent providing devices and/or used by the content providing devicesto provide the decoding complexity to other receiving devices. Thedecoding complexity may be sent to other receiving devices during theinitial SDP offer/answer negotiation, for example.

A codec control message (CCM) may be used to convey control messagesthat may carry feedback information from receiving devices to contentproviding devices. For example, the CCM may be used for a real-timetransport protocol (RTP) audio-visual profile with feedback (AVPF)profile to convey the control messages. The control messages may includean intra-frame request and/or a temporary maximum bit rate.

FIG. 7 is a diagram that depicts an example message 700 that may be usedfor sending decoding complexity feedback information. The message 700may include a source identifier 702 of the message 700. The sourceidentifier 702 may indicate the source from which the message 700 may betransmitted. The message 700 may include feedback control information706. The feedback control information 706 may include the decodingcomplexity feedback information.

The feedback control information 706 may be indicated using a binaryrepresentation. A byte (e.g., the first byte) of the feedback controlinformation 706 may indicate whether the decoding complexity feedbackinformation is indicated as an absolute (e.g., ‘1’) or relative (e.g.,‘0’) measurement. A first message 700 may carry absolute measurements.Subsequent messages may carry relative measurements.

The feedback control information 706 may include a min Value, maxValue,and/or avrValue of the decoding complexity. The minValue, maxValue,and/or avrValue may follow (e.g., respectively) the byte indicatingwhether the decoding complexity feedback information is indicated as anabsolute or relative value. The minValue, maxValue, and/or avrValue maybe 32-bit values. The feedback control information 706 (e.g., in thelast bytes) may be assigned to the string of the units of measurement.The length of the RTCP packet may be used to determine the lastcharacter and/or the length of the string of the units. The number ofbytes N in the length of the RTCP packet may be determined bysubtracting the byte(s) indicating the absolute or relative value and/orthe 32-bit values for the minValue, maxValue, and/or avrValue (e.g., 12bits where all 3 are used). For example, the number of bytes N may bedetermined by N=(length of RTCP pkt)−12−1.

The message 700 may be in an RTCP format. The message 700 may include aheader that may include version (V) field 708, a padding bit (P) field710, a feedback message type (FMT) field 712, a payload type (PT) field714, and/or a length field 716. The V field 708 may include a number ofbits (e.g., 2 bits) that may identify the RTP version. The P field 710may include a number of bits (e.g., 1 bit) that may indicate whether thepacket includes additional padding octets at the end that may beincluded in the length field 716. The FMT field 712 may indicate thetype of feedback message for the message 700. The message 700 may beinterpreted relative to the FMT field 712. An FMT type of fifteen mayindicate an application-layer feedback message, for example. The PTfield 714 may include a number of bits (e.g., 8 bits) that may identifythe packet type. The PT field 714 having a value of ‘206’ may indicatethat the packet type is an RTCP feedback message, for example. Thelength field 716 may include a number of bits (e.g., 16 bits) that mayindicate the length of the packet (e.g., in 32-bit words minus one), andmay include the header and/or any padding bits.

The source identifier 702 may be a synchronization source (SSRC) packetsender field. The source identifier field 702 may include a number ofbits (e.g., 32 bits) that may indicate the source of the message 700.The message 700 may include a media source field 704. The media sourcefield 704 may be an SSRC media source field. The media source field 704may be an identifier that may uniquely identify the source of the media.While the message 700 includes a number of fields, additional fieldsand/or a subset of the described fields may be implemented.

The decoding complexity may be indicated in media files. For example,decoding complexity descriptors may be included in metadata within themedia files. Decoding complexity descriptors may be included withinstored media files. The decoding complexity descriptors may indicate theamount of power that may be used to decode the media content in themedia files. The decoding complexity descriptors may be based on actualdata measured for receiving, decoding, and/or displaying the mediafiles. For example, the decoding complexity descriptors may indicate aminimum value, a maximum value, and/or an average value of power used toreceive, decode, and/or display the media file or portions (e.g., videoframes, audio segments, etc.) thereof. The decoding complexitydescriptors may indicate a minimum amount of time, a maximum amount oftime, and/or an average amount of time to receive, decode, and/ordisplay a media file or portions thereof. The decoding complexitydescriptors may indicate a minimum amount of computing resources, amaximum amount of computing resources, and/or an average amount ofcomputing resources to receive, decode, and/or display a media file orportions thereof. The decoding complexity descriptors may includeabsolute values or relative values. The relative values may indicate anincrease or decrease value from a value of a prior relative decodingcomplexity descriptor. The decoding complexity descriptors may includethe units for the decoding complexity values. Storing the media fileswith the decoding complexity may allow content providing devices to usethe media files within the underlying streaming protocols.

The decoding complexity descriptors may indicate the decoding complexityof one or more segments of a segmented media file. Each segment may haveits own decoding complexity descriptor, or a decoding complexitydescriptor may indicate a decoding complexity for a group of segments.If a relative value is used to indicate the decoding complexity of amedia file segment, the value may be relative to a decoding complexityvalue of a prior segment of the media file. For example, the firstdecoding complexity descriptor of a media file may include an absolutevalue, while other decoding complexity descriptors may include arelative value.

The media files may be in a 3GP file format. The 3GP media file may beconfigured for DASH streaming. The 3GP file format may be structurallybased on the ISO media file format. The ISO media file format may be anobject-oriented format. The objects in the ISO file format may bereferred to as boxes. The boxes may include the media data. In a 3GPadaptive-streaming profile, the boxes may include video data. Forexample, in video profiles that are branded ‘3gh9’, the media data mayinclude movie data. The movie data may be included in movie fragmentboxes (moofs).

In 3GP media files, the decoding complexity may be included in sampleindex data, a fragment header, and/or fragment decoding data. Thedecoding complexity may be indicated in sample index data using asegment index box (sidx). The sidx may provide a compact index of atrack or sub-segment within the media segment to which it may apply. Thesub-segment may be a media stream within the media segment, for example.The sidx may refer to other sidxs in a media segment which may refer toother sub-segments. Each sidx may document how a segment may be dividedinto one or more sub-segments.

The decoding complexity data for each sub-segment may be included in asidx as shown below.

aligned(8) class SegmentIndexBox extends FullBox(‘sidx’, version, 0) {unsigned int(32) reference_ID; unsigned int(32) timescale; if(version==0) } unsigned int(32) earliest_presentation_time; unsignedint(32) first_offset; } else { unsigned int(64)earliest_presentation_time; unsigned int(64) first_offset; } unsignedint(16) reserved = 0; unsigned int(16) reference_count; unsigned int(8)Absolute; unsigned int(8)[8] UnitsDecodingComplexity; for(i=1; i <=reference_count; i++) { bit (1) reference_type; unsigned int(31)referenced_size; unsigned int(32) subsegment_duration; bit(1)starts_with_SAP; unsigned int(3) SAP_type; unsigned int(28)SAP_delta_time; unsigned int(32) minDecodingComplexity; unsigned int(32)maxDecodingComplexity; unsigned int(32) avrDecodingComplexity; } }The sidx box may include a minimum, maximum, and/or average decodingcomplexity. The decoding complexity in the sidx box may include absoluteor relative values. The relative values may the relative to a priorabsolute or relative value. For example, the first decoding complexityin a sidx box may include an absolute value. Subsequent decodingcomplexity values may include absolute or relative values. The sidx boxmay include the units of the decoding complexity.

The decoding complexity data for each sub-segment may be included in atrack fragment header (tfhd) box. The tfhd box may provide basicinformation about each movie fragment of an underlying media track. Thedecoding complexity may be included in the header information for eachfragment as shown below.

aligned(8) class TrackFragmentHeaderBox extends FullBox(‘tfhd’, 0,tf_flags){  unsigned int(32) track_ID; unsigned int(64)base_data_offset; unsigned int(32) sample_description_index; unsignedint(32) default_sample_duration; unsigned int(32) default_sample_size;unsigned int(32) default_sample_flags unsigned int(8) Absolute; unsignedint(32) minDecodingComplexity; unsigned int(32) maxDecodingComplexity;unsigned int(32) avrDecodingComplexity; unsigned int(8)[8]UnitsDecodingComplexity; }The tfhd box may include a minimum, maximum, and/or average decodingcomplexity. The decoding complexity in the tfhd box may include absoluteor relative values. The relative values may the relative to a priorabsolute or relative value. For example, the first decoding complexityin a tfhd box may include an absolute value. Subsequent decodingcomplexity values may include absolute or relative values. The tfhd boxmay include the units of the decoding complexity.

The decoding complexity may be included in a track fragment base mediadecode time (tfdt) box. The tfdt box may provide the decode lime of asample in the track fragment. The sample in which the decoding time maybe included may be the first sample of the track fragment. The tfdt boxmay be used when performing random access in a file. The decodingcomplexity for each fragment or sub-sample may be included as shown inthe class below.

aligned(8) class TrackFragmentBaseMediaDecodeTimeBox extendsFullBox(‘tfdt’, version, 0) { if (version==1) { unsigned int(64)baseMediaDecodeTime; } else {// version==0 unsigned int(32)baseMediaDecodeTime; } unsigned int(8) Absolute; unsigned int(32)minDecodingComplexity; unsigned int(32) maxDecodingComplexity; unsignedint(32) avrDecodingComplexity; unsigned int(8)[8]UnitsDecodingComplexity; }The tfdt box may include a minimum, maximum, and/or average decodingcomplexity. The decoding complexity in the tfdt box may include absoluteor relative values. The relative values may the relative to a priorabsolute or relative value. For example, the first decoding complexityin a tfdt box may include an absolute value. Subsequent decodingcomplexity values may include absolute or relative values. The tfdt boxmay include the units of the decoding complexity.

The decoding complexity may be included in real-time protocol (RTP)and/or realtime control protocol (RTCP) streaming. For example, if mediatracks may be stored in fragmented boxes, the decoding complexity may beincluded in tfdt and/or tfhd boxes that may be applied to RTP and/orRTCP streaming. Hint tracks may carry transport specific informationthat may be used by a content providing device to create the RTP and/orRTCP packets.

The decoding complexity may be included in a hint media header (hmhd)box. For example, the decoding complexity may be included for a wholevideo hint track, which may provide a coarse approach for trackselection by the WTRU or other receiving device of the media content. Anexample of an hmhd box including the decoding complexity is shown below.

aligned(8) class HintMediaHeaderBox extends FullBox(‘hmhd’, version = 0,0) { unsigned int(16) maxPDUsize; unsigned int(16) avgPDUsize; unsignedint(32) maxbitrate; unsigned int(32) avgbitrate; unsigned int(32)reserved = 0; unsigned int(8) Absolute; unsigned int(32)minDecodingComplexity; unsigned int(32) maxDecodingComplexity: unsignedint(32) avrDecodingComplexity; unsigned int(8)[8]UnitsDecodingComplexity; }The hmhd box may include a minimum, maximum, and/or average decodingcomplexity. The decoding complexity in the hmhd box may include absoluteor relative values. The relative values may the relative to a priorabsolute or relative value. For example, the first decoding complexityin a hmhd box may include an absolute value. Subsequent decodingcomplexity values may include absolute or relative values. The hmhd boxmay include the units of the decoding complexity.

The decoding complexity feedback may be included in quality ofexperience (QoE) reporting. For example, decoding complexity descriptorsmay be included within an event reporting service that may be sent fromthe WTRU. The actual WTRU decoding complexity feedback may be used bythe content providing device to attach or update the decoding complexitydescriptors. The decoding complexity descriptors may be included withina file format, such as a 3GP file format for example, or within one ormore streaming protocols.

The QoE reporting may include DASH QoE reporting. For a DASH client, QoEreporting may be optional. The QoE reporting may use an averagethroughput metric, an initial playout delay metric, and/or a bufferlevel metric. TABLE 1 shows an example for including the decodingcomplexity feedback as a metric in QoE reports.

TABLE 1 Decoding Complexity Feedback Key Type DescriptionDecodingComplexity Object Variability of the decoding complexityobserved by the client during the measurement interval absolute BoolIndicates whether the reported values are absolute or relative metricsavrValue Integer The average decoding complexity during the measurementinterval minValue Integer The minimum decoding complexity during themeasurement interval maxValue Integer The maximum decoding complexityduring the measurement interval T Real The real-time of the start of theTime measurement interval duration Integer The time of the measurementinterval units String A value that may denote the units for the reportedvalues deviceSpecs String A value that may indicate devicecharacteristics or specifications, such as device type, make, model,release date, OS version, device drivers, player agent, available power,power consumption configurations, and/ or the likeAs shown in TABLE 1, the decoding complexity feedback may indicate thedecoding complexity for receiving, decoding, and/or displaying mediacontent at a WTRU. The decoding complexity may be in terms of absoluteor relative value. The absolute or relative value may be a boolean valuethat may indicate if the reported values are in absolute or relativemetrics (e.g., “1’ for absolute and/or ‘0’ for relative). The decodingcomplexity may include a minimum, maximum, and/or average decodingcomplexity value measured during a measurement interval. The minimum,maximum, and/or average decoding complexity value may be an integervalue, a character value, and/or the like. The decoding complexityfeedback may indicate the units for the reported decoding complexityvalues.

The decoding complexity feedback truly indicate a start time and/or aduration of the measurement interval. The start time may include a realtime value at which the decoding complexity values were measured. Theduration of the measurement interval may include a period of time overwhich the decoding complexity values were measured. For example, theduration may include an integer value that indicates the time (e.g., inmilliseconds, seconds, etc.) over which the measurements were performed.

The decoding complexity feedback may include the device configurationsor device specifications that may identify the WTRU at which themeasurements are performed. For example, decoding complexity feedbackmay include the device type, make, model, release date, OS version,device drivers, player agent, available power, power consumptionconfigurations, and/or the like of the WTRU at which the measurementswere performed for receiving, decoding, and/or displaying the mediacontent. The decoding complexity feedback may include a uniqueidentifier that indicates the device from which the decoding complexityfeedback is being received.

The RTCP protocol may allow or enable WTRUs to send WTRU reports thatmay be extended to include decoding complexity reports from the WTRUs inan application specific (APP) RTCP type. The RTCP extension may be usedby WTRUs to report QoE metrics. An RTCP application type (e.g., FMT=15)may be used to send device specs from WTRUs to content delivery devicesduring (e.g., at the beginning of) a streaming session.

FIG. 8A is a diagram that depicts an example communications system 800in which one or more disclosed embodiments may be implemented. Thecommunications system 800 may be a multiple access system that providescontent, such as voice, data, video, messaging, broadcast, etc., tomultiple wireless users. The communications system 800 may enablemultiple wireless users to access such content through the sharing ofsystem resources, including wireless bandwidth. For example, thecommunications systems 800 may employ one or more channel accessmethods, such as code division multiple access (CDMA), time divisionmultiple access (TDMA), frequency division multiple access (FDMA),orthogonal FDMA (OFDMA), single-carrier FDMA (SC-FDMA), and/or the like.

As shown in FIG. 8A, the communications system 800 may include wirelesstransmit/receive units (WTRUs) 802 a, 802 b, 802 c, and/or 802 d (whichgenerally or collectively may be referred to as WTRU 802), a radioaccess network (RAN) 803/804/805, a core network 806/807/809, a publicswitched telephone network (PSTN) 808, the Internet 810, and othernetworks 812, though any number of WTRUs, base stations, networks,and/or network elements may be used. Each of the WTRUs 802 a, 802 b, 802c, and/or 802 d may be any type of device configured to operate and/orcommunicate in a wireless environment. The WTRUs 802 a, 802 b, 802 c,and/or 802 d may be configured to transmit and/or receive wirelesssignals and may include user equipment (UE), a mobile station, a fixedor mobile subscriber unit, a pager, a cellular telephone, a personaldigital assistant (PDA), a smartphone, a laptop, a netbook, a personalcomputer, a wireless sensor, consumer electronics, and/or the like.

The communications systems 800 may also include a base station 814 aand/or a base station 814 b. Each of the base stations 814 a, 814 b maybe any type of device configured to wirelessly interface with at leastone of the WTRUs 802 a, 802 b, 802 c, and/or 802 d to facilitate accessto one or more communication networks, such as the core network806/807/809, the Internet 810, and/or the networks 812. The basestations 814 a and/or 814 b may be a base transceiver station (BTS), aNode-B, an eNode B, a Home Node B, a Home eNode B, a site controller, anaccess point (AP), a wireless router, and/or the like. While the basestations 814 a, 814 b are each depicted as a single element, the basestations 814 a, 814 b may include any number of interconnected basestations and/or network elements.

The base station 814 a may be part of the RAN 803/804/805, which mayalso include other base stations and/or network elements (not shown),such as a base station controller (BSC), a radio network controller(RNC), relay nodes, etc. The base station 814 a and/or the base station814 b may be configured to transmit and/or receive wireless signalswithin a particular geographic region, which may be referred to as acell (not shown). The cell may further be divided into cell sectors. Forexample, the cell associated with the base station 814 a may be dividedinto three sectors. Thus, the base station 814 a may include threetransceivers, e.g., one for each sector of the cell. The base station814 a may employ multiple-input multiple output (MIMO) technology and,therefore, may utilize multiple transceivers for each sector of thecell.

The base stations 814 a and/or 814 b may communicate with one or more ofthe WTRUs 802 a, 802 b, 802 c, and/or 802 d over an air interface815/816/817, which may be any suitable wireless communication link(e.g., radio frequency (RF), microwave, infrared (IR), ultraviolet (UV),visible light, etc.). The air interface 815/816/817 may be establishedusing any suitable radio access technology (RAT).

The communications system 800 may be a multiple access system and/or mayemploy one or more channel access schemes, such as CDMA, TDMA, FDMA,OFDMA, SC-FDMA, and/or the like. For example, the base station 814 a inthe RAN 803/804/805 and the WTRUs 802 a, 802 b, and/or 802 c mayimplement a radio technology such as UMTS Terrestrial Radio Access(UTRA), which may establish the air interface 815/816/817 using widebandCDMA (WCDMA). WCDMA may include communication protocols such asHigh-Speed Packet Access (HSPA) and/or Evolved HSPA (HSPA+). HSPA mayinclude High-Speed Downlink Packet Access (HSDPA) and/or High-SpeedUplink Packet Access (HSUPA).

The base station 814 a and the WTRUs 802 a, 802 b, and/or 802 c mayimplement a radio technology such as E-UTRA, which may establish the airinterface 815/816/817 using Long Term Evolution (LTE) and/orLTE-Advanced (LTE-A).

The base station 814 a and the WTRUs 802 a, 802 b, and/or 802 c mayimplement radio technologies such as IEEE 802.16 (e.g., WorldwideInteroperability for Microwave Access (WiMAX)), CDMA2000, CDMA2000 1×,CDMA2000 EV-DO, Interim Standard 2000 (IS-2000), Interim Standard 95(IS-95), Interim Standard 856 (IS-856), Global System for Mobilecommunications (GSM), Enhanced Data rates for GSM Evolution (EDGE), GSMEDGE (GERAN), and/or the like.

The base station 8146 in FIG. 8A may be a wireless router, Home Node B,Home eNode B, or access point, for example, and may utilize any suitableRAT for facilitating wireless connectivity in a localized area, such asa place of business, a home, a vehicle, a campus, and/or the like. Thebase station 814 b and the WTRUs 802 c, 802 d may implement a radiotechnology such as IEEE 802.11 to establish a wireless local areanetwork (WLAN). The base station 814 b and the WTRUs 802 c, 802 d mayimplement a radio technology such as IEEE 802.15 to establish a wirelesspersonal area network (WPAN). The base station 814 b and the WTRUs 802c, 802 d may utilize a cellular-based RAT (e.g., WCDMA, CDMA2000, GSM,LTE, LTE-A, etc.) to establish a picocell or femtocell. As shown in FIG.8A, the base station 814 b may have a direct connection to the Internet810. Thus, the base station 814 b may not access the Internet 810 viathe core network 806/807/809.

The RAN 803/804/805 may be in communication with the core network806/807/809, which may be any type of network configured to providecontent, such as voice, data, applications, media, and/or voice overinternet protocol (VoIP) services to one or more of the WTRUs 802 a, 802b, 802 c, and/or 802 d. For example, the core network 806/807/809 mayprovide call control, billing services, mobile location-based services,pre-paid calling, Internet connectivity, video distribution, etc.,and/or perform high-level security functions, such as userauthentication. Although not shown in FIG. 8A, the RAN 803/804/805and/or the core network 806/807/809 may be in direct or indirectcommunication with other RANs that employ the same RAT as the RAN803/804/805 or a different RAT. For example, in addition to beingconnected to the RAN 803/804/805, which may be utilizing an E-UTRA radiotechnology, the core network 806/807/809 may also be in communicationwith another RAN (not shown) employing a GSM radio technology.

The core network 806/807/809 may serve as a gateway for the WTRUs 802 a,802 b, 802 c, and/or 802 d to access the PSTN 808, the Internet 810,and/or other networks 812. The PSTN 808 may include circuit-switchedtelephone networks that provide plain old telephone service (POTS). TheInternet 810 may include a global system of interconnected computernetworks and devices that use common communication protocols, such asthe transmission control protocol (TCP), user datagram protocol (UDP)and the internet protocol (IP) in the TCP/IP internet protocol suite.The networks 812 may include wired and/or wireless communicationsnetworks owned and/or operated by other service providers. For example,the networks 812 may include another core network connected to one ormore RANs, which may employ the same RAT as the RAN 803/804/805 or adifferent RAT.

Some or all of the WTRUs 802 a, 802 b, 802 c, and/or 802 d in thecommunications system 800 may include multi-mode capabilities, e.g., theWTRUs 802 a, 802 b, 802 c, and/or 802 d may include multipletransceivers for communicating with different wireless networks overdifferent wireless links. For example, the WTRU 802 c shown in FIG. 8Amay be configured to communicate with the base station 814 a, which mayemploy a cellular-based radio technology, and with the base station 814b, which may employ an IEEE (e.g., IEEE 802.11) radio technology.

FIG. 8B depicts a system diagram of an example WTRU 802. As shown inFIG. 8B, the WTRU 802 may include a processor 818, a transceiver 820, atransmit/receive element 822, a speaker/microphone 824, a keypad 826, adisplay/touchpad 828, non-removable memory 830, removable memory 832, apower source 834, a global positioning system (GPS) chipset 836, and/orother peripherals 838. The WTRU 802 may include any sub-combination ofthe foregoing elements.

Other devices described herein may include some or all of the elementsdepicted in FIG. 8B and described herein. For example, the base stations814 a and 814 b, and/or the nodes that base stations 814 a and 814 b mayrepresent, such as but not limited to transceiver station (BTS), aNode-B, a site controller, an access point (AP), a home node-B, anevolved home node-B (eNodeB), a home evolved node-B (HeNB), a homeevolved node-B gateway, and proxy nodes, among others, may include someor all of the elements depicted in FIG. 8B and described herein. Acontent providing device may also include some or all of the elementsdepicted in FIG. 8B and described herein. For example, the contentproviding device may use the non-removable memory 830 and/or removablememory 832 to store WTRU identifiers, WTRU configuration information,decoding complexity information, and/or other information describedherein.

The processor 818 may be a general purpose processor, a special purposeprocessor, a conventional processor, a digital signal processor (DSP), aplurality of microprocessors, one or more microprocessors in associationwith a DSP core, a controller, a microcontroller, Application SpecificIntegrated Circuits (ASICs), Field Programmable Gate Array (FPGAs)circuits, any other type of integrated circuit (IC), a state machine,and the like. The processor 818 may perform signal coding, dataprocessing, power control, input/output processing, and/or any otherfunctionality that enables the WTRU 802 to operate in a wirelessenvironment and/or operate to process video content. The processor 818may be coupled to the transceiver 820, which may be coupled to thetransmit/receive element 822. While FIG. 8B depicts the processor 818and the transceiver 820 as separate components, the processor 818 andthe transceiver 820 may be integrated together in an electronic packageor chip.

The transmit/receive element 822 may be configured to transmit signalsto, or receive signals from, a base station (e.g., the base station 814a) over the air interface 815/816/817. For example, the transmit/receiveelement 822 may be an antenna configured to transmit and/or receive RFsignals. The transmit/receive element 822 may be an emitter/detectorconfigured to transmit and/or receive IR, UV, and/or visible lightsignals, for example. The transmit/receive element 822 may be configuredto transmit and receive RF and light signals. The transmit/receiveelement 822 may be configured to transmit and/or receive any combinationof wireless signals.

Although the transmit/receive element 822 is depicted in FIG. 8B as asingle element, the WTRU 802 may include any number of transmit/receiveelements 822. More specifically, the WTRU 802 may employ MIMOtechnology. Thus, the WTRU 802 may include two or more transmit/receiveelements 822 (e.g., multiple antennas) for transmitting and/or receivingwireless signals over the air interface 815/816/817.

The transceiver 820 may be configured to modulate the signals that areto be transmitted by the transmit/receive element 822 and/or todemodulate the signals that are received by the transmit/receive element822. As noted above, the WTRU 802 may have multi-mode capabilities.Thus, the transceiver 820 may include multiple transceivers for enablingthe WTRU 802 to communicate via multiple RATs, such as UTRA and IEEE802.11, for example.

The processor 818 of the WTRU 802 may be coupled to, and may receiveuser input data from, the speaker/microphone 824, the keypad 826, and/orthe display/touchpad 828 (e.g., a liquid crystal display (LCD) displayunit or organic light-emitting diode (OLED) display unit). The processor818 may output user data to the speaker/microphone 824, the keypad 826,and/or the display/touchpad 828. The processor 818 may accessinformation from, and/or store data in, any type of suitable memory,such as the non-removable memory 830 and/or the removable memory 832.The non-removable memory 830 may include random-access memory (RAM),read-only memory (ROM), a hard disk, or any other type of memory storagedevice. The removable memory 832 may include a subscriber identitymodule (SIM) card, a memory stick, a secure digital (SD) memory card,and/or the like. The processor 818 may access information from, and/orstore data in, memory that is not physically located on the WTRU 802,such as on a server or a home computer (not shown).

The processor 818 may receive power from the power source 834, and maybe configured to distribute and/or control the power to the othercomponents in the WTRU 802. The power source 834 may be any suitabledevice for powering the WTRU 802. For example, the power source 834 mayinclude one or more dry cell batteries (e.g., nickel-cadmium (NiCd),nickel-zinc (NiZn), nickel metal hydride (NiMH), lithium-ion (Li-ion),etc.), solar cells, fuel cells, and/or the like.

The processor 818 may also be coupled to the GPS chipset 836, which maybe configured to provide location information (e.g., longitude andlatitude) regarding the current location of the WTRU 802. In additionto, or in lieu of, the information from the GPS chipset 836, the WTRU802 may receive location information over the air interface 815/816/817from a base station (e.g., base stations 814 a, 814 b) and/or determineits location based on the timing of the signals being received from twoor more nearby base stations. The WTRU 802 may acquire locationinformation by way of any suitable location-determination method.

The processor 818 may further be coupled to other peripherals 838, whichmay include one or more software and/or hardware modules that provideadditional features, functionality and/or wired or wirelessconnectivity. For example, the peripherals 838 may include anaccelerometer, an e-compass, a satellite transceiver, a digital camera(for photographs or video), a universal serial bus (USB) port, avibration device, a television transceiver, a hands free headset, aBluetooth® module, a frequency modulated (FM) radio unit, a digitalmusic player, a media player, a video game player module, an Internetbrowser, and/or the like.

FIG. 8C depicts a system diagram of the RAN 803 and the core network 806according to an embodiment. As noted above, the RAN 803 may employ aUTRA radio technology to communicate with the WTRUs 802 a, 802 b, and/or802 c over the air interface 815. The RAN 803 may also be incommunication with the core network 806. As shown in FIG. 8C, the RAN803 may include Node-Bs 840 a, 840 b, and/or 840 c, which may eachinclude one or more transceivers for communicating with the WTRUs 802 a,802 b, and/or 802 c over the air interface 815. The Node-Bs 840 a, 840b, and/or 840 c may each be associated with a particular cell (notshown) within the RAN 803. The RAN 803 may also include RNCs 842 aand/or 842 b. The RAN 803 may include any number of Node-Bs and RNCs.

As shown in FIG. 8C, the Node-Bs 840 a and/or 840 b may be incommunication with the RNC 842 a. The Node-B 840 c may be incommunication with the RNC 842 b. The Node-Bs 840 a, 840 b, and/or 840 cmay communicate with the respective RNCs 842 a, 842 b via an Iubinterface. The RNCs 842 a, 842 b may be in communication with oneanother via an Iur interface. Each of the RNCs 842 a, 842 b may beconfigured to control the respective Node-Bs 840 a, 840 b, and/or 840 cto which it is connected. Each of the RNCs 842 a, 842 b may beconfigured to carry out or support other functionality, such as outerloop power control, load control, admission control, packet scheduling,handover control, macrodiversity, security functions, data encryption,and/or the like.

The core network 806 shown in FIG. 8C may include a media gateway (MGW)844, a mobile switching center (MSC) 846, a serving GPRS support node(SGSN) 848, and/or a gateway GPRS support node (GGSN) 850. While each ofthe foregoing elements are depicted as part of the core network 806, anyone of these elements may be owned and/or operated by an entity otherthan the core network operator.

The RNC 842 a in the RAN 803 may be connected to the MSC 846 in the corenetwork 806 via an IuCS interface. The MSC 846 may be connected to theMGW 844. The MSC 846 and the MGW 844 may provide the WTRUs 802 a, 802 b,and/or 802 c with access to circuit-switched networks, such as the PSTN808, to facilitate communications between the WTRUs 802 a, 802 b, and/or802 c and traditional land-line communications devices.

The RNC 842 a in the RAN 803 may be connected to the SGSN 848 in thecore network 806 via an IuPS interface. The SGSN 848 may be connected tothe GGSN 850. The SGSN 848 and the GGSN 850 may provide the WTRUs 802 a,802 b, and/or 802 c with access to packet-switched networks, such as theInternet 810, to facilitate communications between and the WTRUs 802 a,802 b, and/or 802 c and IP-enabled devices.

As noted above, the core network 806 may also be connected to thenetworks 812, which may include other wired and/or wireless networksthat may be owned and/or operated by other service providers.

FIG. 8D depicts a system diagram of the RAN 804 and the core network 807according to an embodiment. As noted above, the RAN 804 may employ anE-UTRA radio technology to communicate with the WTRUs 802 a, 802 b,and/or 802 c over the air interface 816. The RAN 804 may also be incommunication with the core network 807.

The RAN 804 may include eNode-Bs 860 a, 860 b, and/or 860 c, though theRAN 804 may include any number of eNode-Bs. The eNode-Bs 860 a, 860 b,and/or 860 c may each include one or more transceivers for communicatingwith the WTRUs 802 a, 802 b, and/or 802 c over the air interface 816.The eNode-Bs 860 a, 860 b, and/or 860 c may implement MIMO technology.Thus, the eNode-B 860 a, for example, may use multiple antennas totransmit wireless signals to, and/or receive wireless signals from, theWTRU 802 a.

Each of the eNode-Bs 860 a, 860 b, and/or 860 c may be associated with aparticular cell (not shown) and may be configured to handle radioresource management decisions, handover decisions, scheduling of usersin the uplink and/or downlink, and/or the like. As shown in FIG. 8D, theeNode-Bs 860 a, 860 b, and/or 860 c may communicate with one anotherover an X2 interface.

The core network 807 shown in FIG. 8D may include a mobility managementgateway (MME) 862, a serving gateway 864, and a packet data network(PDN) gateway 866. While each of the foregoing elements are depicted aspart of the core network 807, any one of these elements may be ownedand/or operated by an entity other than the core network operator.

The MME 862 may be connected to each of the eNode-Bs 860 a, 860 b,and/or 860 c in the RAN 804 via an S1 interface and may serve as acontrol node. For example, the MME 862 may be responsible forauthenticating users of the WTRUs 802 a, 802 b, and/or 802 c, beareractivation/deactivation, selecting a particular serving gateway duringan initial attach of the WTRUs 802 a, 802 b, and/or 802 c, and/or thelike. The MME 862 may provide a control plane function for switchingbetween the RAN 804 and other RANs (not shown) that may employ otherradio technologies, such as GSM or WCDMA.

The serving gateway 864 may be connected to each of the eNode-Bs 860 a,860 b, and/or 860 c in the RAN 804 via the S1 interface. The servinggateway 864 may generally route and/or forward user data packets to/fromthe WTRUs 802 a, 802 b, and/or 802 c. The serving gateway 864 mayperform other functions, such as anchoring user planes duringinter-eNode B handovers, triggering paging when downlink data isavailable for the WTRUs 802 a, 802 b, and/or 802 c, managing and storingcontexts of the WTRUs 802 a, 802 b, and/or 802 c, and/or the like.

The serving gateway 864 may be connected to the PDN gateway 866, whichmay provide the WTRUs 802 a, 802 b, and/or 802 c with access topacket-switched networks, such as the Internet 810, to facilitatecommunications between the WTRUs 802 a, 802 b, and/or 802 c andIP-enabled devices.

The core network 807 may facilitate communications with other networks.For example, the core network 807 may provide the WTRUs 802 a, 802 b,and/or 802 c with access to circuit-switched networks, such as the PSTN808, to facilitate communications between the WTRUs 802 a, 802 b, and/or802 c and traditional land-line communications devices. For example, thecore network 807 may include, or may communicate with, an IP gateway(e.g., an IP multimedia subsystem (IMS) server) that serves as aninterface between the core network 807 and the PSTN 808. The corenetwork 807 may provide the WTRUs 802 a, 802 b, and/or 802 c with accessto the networks 812, which may include other wired and/or wirelessnetworks that may be owned and/or operated by other service providers.

FIG. 8E depicts a system diagram of the RAN 805 and the core network809. The RAN 805 may be an access service network (ASN) that employsIEEE 802.16 radio technology to communicate with the WTRUs 802 a, 802 b,and/or 802 c over the air interface 817. As will be further describedherein, the communication links between the different functionalentities of the WTRUs 802 a, 802 b, and/or 802 c, the RAN 805, and thecore network 809 may be defined as reference points.

As shown in FIG. 8E, the RAN 805 may include base stations 880 a, 880 b,and/or 880 c, and an ASN gateway 882, though the RAN 805 may include anynumber of base stations and/or ASN gateways. The base stations 880 a,880 b, and/or 880 c may each be associated with a particular cell (notshown) in the RAN 805 and/or may each include one or more transceiversfor communicating with the WTRUs 802 a, 802 b, and/or 802 c over the airinterface 817. The base stations 880 a, 880 b, and/or 880 c mayimplement MIMO technology. Thus, the base station 880 a, for example,may use multiple antennas to transmit wireless signals to, and/orreceive wireless signals from, the WTRU 802 a. The base stations 880 a,880 b, and/or 880 c may provide mobility management functions, such ashandoff triggering, tunnel establishment, radio resource management,traffic classification, quality of service (QoS) policy enforcement,and/or the like. The ASN gateway 882 may serve as a traffic aggregationpoint and may be responsible for paging, caching of subscriber profiles,routing to the core network 809, and/or the like.

The air interface 817 between the WTRUs 802 a, 802 b, and/or 802 c andthe RAN 805 may be defined as an R1 reference point that implements theIEEE 802.16 specification. Each of the WTRUs 802 a, 802 b, and/or 802 cmay establish a logical interface (not shown) with the core network 809.The logical interface between the WTRUs 802 a, 802 b, and/or 802 c andthe core network 809 may be defined as an R2 reference point, which maybe used for authentication, authorization, IP host configurationmanagement, and/or mobility management.

The communication link between each of the base stations 880 a, 880 b,and/or 880 c may be defined as an R8 reference point that includesprotocols for facilitating WTRU handovers and/or the transfer of databetween base stations. The communication link between the base stations880 a, 880 b, and/or 880 c and the ASN gateway 882 may be defined as anR6 reference point. The R6 reference point may include protocols forfacilitating mobility management based on mobility events associatedwith each of the WTRUs 802 a, 802 b, and/or 802 c.

As shown in FIG. 8E, the RAN 805 may be connected to the core network809. The communication link between the RAN 805 and the core network 809may defined as an R3 reference point that may include protocols forfacilitating data transfer and mobility management capabilities, forexample. The core network 809 may include a mobile IP home agent(MIP-HA) 884, an authentication, authorization, accounting (AAA) server886, and/or a gateway 888. While each of the foregoing elements aredepicted as part of the core network 809, any one of these elements maybe owned and/or operated by an entity other than the core networkoperator.

The MIP-HA 884 may be responsible for IP address management, and mayenable the WTRUs 802 a, 802 b, and/or 802 c to roam between differentASNs and/or different core networks. The MIP-HA 884 may provide theWTRUs 802 a, 802 b, and/or 802 c with access to packet-switchednetworks, such as the Internet 810, to facilitate communications betweenthe WTRUs 802 a, 802 b, and/or 802 c and IP-enabled devices. The AAAserver 886 may be responsible for user authentication and for supportinguser services. The gateway 888 may facilitate interworking with othernetworks. For example, the gateway 888 may provide the WTRUs 802 a, 802b, and/or 802 c with access to circuit-switched networks, such as thePSTN 808, to facilitate communications between the WTRUs 802 a, 802 b,and/or 802 c and traditional land-line communications devices. Thegateway 888 may provide the WTRUs 802 a, 802 b, and/or 802 c with accessto the networks 812, which may include other wired and/or wirelessnetworks that may be owned and/or operated by other service providers.

Although not shown in FIG. 8E, the RAN 805 may be connected to otherASNs and/or the core network 809 may be connected to other corenetworks. The communication link between the RAN 805 the other ASNs maybe defined as an R4 reference point, which may include protocols forcoordinating the mobility of the WTRUs 802 a, 802 b, and/or 802 cbetween the RAN 805 and the other ASNs. The communication link betweenthe core network 809 and the other core networks may be defined as an R5reference, which may include protocols for facilitating interworkingbetween home core networks and visited core networks.

Although features and elements are described above in particularcombinations, each feature or element may be used alone or in anycombination with the other features and/or elements. The methodsdescribed herein may be implemented in a computer program, software, orfirmware incorporated in a computer-readable medium for execution by acomputer or processor. Examples of computer-readable media includeelectronic signals (transmitted over wired or wireless connections)and/or computer-readable storage media. Examples of computer-readablestorage media include, but are not limited to, a read only memory (ROM),a random access memory (RAM), a register, cache memory, semiconductormemory devices, magnetic media such as internal hard disks and removabledisks, magneto-optical media, and/or optical media such as CD-ROM disks,and digital versatile disks (DVDs). A processor in association withsoftware may be used to implement a radio frequency transceiver for usein a WTRU, UE, terminal, base station, RNC, content providing device,and/or any host computer.

1.-20. (canceled)
 21. A method for a wireless transmit/receive unit(WTRU) to determine decoding complexity information associated withmedia content, the method comprising: sending a request for the mediacontent to a content providing device; receiving the media content;decoding the media content; displaying the media content; determiningthe decoding complexity information that indicates at least one of poweror time used to decode or display the media content at the WTRU; andsending the decoding complexity information to a remote source.
 22. Themethod of claim 21, further comprising: receiving decoding complexityinformation associated with second media content, wherein the decodingcomplexity information associated with second media content indicates atleast one of power or time used to decode or display the second mediacontent at one or more reference WTRUs; determining to receive thesecond media content based on the decoding complexity informationassociated with the second media content; and sending a request to thecontent providing device for the second media content.
 23. The method ofclaim 22, further comprising: receiving decoding complexity informationfor each of a plurality of different types of the second media content;determining to receive a preferred type of the second media content outof the plurality of different types of the second media content based onthe decoding complexity information associated with each type of thesecond media content; and sending a request to the content providingdevice for the preferred type of the second media content.
 24. Themethod of claim 22, further comprising receiving a media presentationdescriptor (MPD) file for the second media content, the MPD filecomprising the decoding complexity information associated with thesecond media content.
 25. The method of claim 21, wherein the mediacontent comprises a plurality of segments, and wherein the methodfurther comprises: determining a corresponding decoding complexityinformation for each segment of the media content; and sending thecorresponding decoding complexity information for each segment of themedia content to the remote source.
 26. The method of claim 21, whereinthe decoding complexity information comprises a time at which a decodingcomplexity was measured, a duration for which the decoding complexitywas measured, or device specifications relating to the WTRU.
 27. Themethod of claim 21, further comprising measuring an amount of power usedwhile decoding or displaying the media content to determine the decodingcomplexity information associated with the media content.
 28. The methodof claim 21, further comprising measuring a maximum amount of power, aminimum amount of power, or an average amount of power used whiledecoding or displaying the media content to determine the decodingcomplexity information associated with the media content.
 29. The methodof claim 28, wherein the average amount of power is calculated bydividing a sum of the minimum amount of power and the maximum amount ofpower by two.
 30. The method of claim 21, wherein the decodingcomplexity information is included in an HTTP request sent to a dynamicadaptive streaming over HTTP (DASH) server.
 31. A wirelesstransmit/receive unit (WTRU) comprising: a processor configured to: senda request for media content to a content providing device; receive themedia content; decode the media content; display the media content;determine decoding complexity information that indicates at least one ofpower or time used to decode or display the media content at the WTRU;and send the decoding complexity information to a remote source.
 32. TheWTRU of claim 31, wherein the processor is further configured to:receive decoding complexity information associated with second mediacontent, wherein the decoding complexity information indicates at leastone of power or time used to decode or display the second media contentat one or more reference WTRUs; determine to receive the second mediacontent based on the decoding complexity information associated with thesecond media content; and send a request to the content providing devicefor the second media content.
 33. The WTRU of claim 32, wherein theprocessor is further configured to: receive decoding complexityinformation for each of a plurality of different types of the secondmedia content; determine to receive a preferred type of the second mediacontent out of the plurality of different types of the second mediacontent based on the decoding complexity information associated witheach type of the second media content; and send a request to the contentproviding device for the preferred type of the second media content. 34.The WTRU of claim 32, wherein the processor is further configured toreceive a media presentation descriptor (MPD) file for the second mediacontent, the MPD file comprising the decoding complexity informationassociated with the second media content.
 35. The WTRU of claim 31,wherein the media content comprises a plurality of segments, and whereinthe processor is further configured to: determine a correspondingdecoding complexity information for each segment of the media content;and send the corresponding decoding complexity information for eachsegment of the media content to the remote source.
 36. The WTRU of claim31, wherein the decoding complexity information comprises a time atwhich a decoding complexity was measured, a duration for which thedecoding complexity was measured, or device specifications relating tothe WTRU.
 37. The WTRU of claim 31, wherein the processor is furtherconfigured to measure an amount of power used while decoding ordisplaying the media content to determine the decoding complexityinformation associated with the media content.
 38. The WTRU of claim 31,wherein the processor is further configured to measure a maximum amountof power, a minimum amount of power, or an average amount of power usedwhile decoding or displaying the media content to determine the decodingcomplexity information associated with the media content.
 39. The WTRUof claim 38, wherein the average amount of power is calculated bydividing a sum of the minimum amount of power and the maximum amount ofpower by two.
 40. The WTRU of claim 31, wherein the decoding complexityinformation is included in an HTTP request sent to a dynamic adaptivestreaming over HTTP (DASH) server.